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Abstract. We show that measures with finite support on the real line are the 
unique solution to an algorithm, named generalized minimal extrapolation, in- 
volving only a finite number of generalized moments (which encompass the stan- 
dard moments, the Laplace transform, the Stieltjes transformation, etc). 

Generalized minimal extrapolation shares related geometric properties with 
basis pursuit of Chen, Donoho and Saunders [CDS98]. Indeed we also extend 
some standard results of compressed sensing (the dual polynomial, the nullspace 
property) to the signed measure framework. 

We express exact reconstruction in terms of a simple interpolation problem. 
We prove that every nonnegative measure, supported by a set containing s points, 
can be exactly recovered from only 2s + 1 generalized moments. This result leads 
to a new construction of deterministic sensing matrices for compressed sensing. 



Introduction 

In the last decade much emphasis has been put on the exact reconstruction of 
sparse finite dimensional vectors using the basis pursuit algorithm. The pioneering 
paper of Chen, Donoho and Saunders [CDS01] has brought this method to the 
statistics community. Note that the seminal ideas on the subject appeared in 
earlier works of Donoho and Stark [DS89]. Therein, mainly the discrete Fourier 
transform is considered. Similarly P. Doukhan, E. Gassiat and one author of this 
present paper [DG96, GG96] considered the exact reconstruction of a nonnegative 
measure. More precisely they derived results when one only knows the values of 
a finite number of linear functionals at the target measure. Moreover, they study 
stability with respect to a metric for weak convergence which is not the case here. 

In this paper, we are concerned with the measure framework. We show that the 
exact reconstruction of a signed measure is still possible when one only knows 
a finite number of non-adaptive linear measurements. Surprisingly our method, 
called generalized minimal extrapolation, appears to uncover exact reconstruction 
results related to basis pursuit. 

Let us explain more precisely what is done here. Consider a signed discrete 
measure a on a set I. Unless otherwise specified, assume that I := [—1,1]. Note 
that all our results easily extend to any real bounded set. Consider the Jordan 
decomposition, 

a = a + - cr~, 
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and denote by S + (resp. <S~) the support of u + (resp. cr~). Let us define the 
Jordan support of the measure o~ as the pair J := (S + ,S~). Assume further that 
iS := S + U S~ is finite and has cardinality s. Moreover suppose that J belongs 
to a family Y of pairs of subsets of J (see Definition 1 for more details). We call Y 
a Jordan support family '. The measure o~ can be written as 

s 

i=l 

where S = {x\, . . . , x s }, o~\, . . ,,o~ s are nonzero real numbers, and 5 X denotes the 
Dirac measure at point x. 

Let T = { Uq, U\, . . . , u n } be any family of continuous functions on I, where 
the set I denotes the closure of I (this statement is meant to be general and 
encompasses the case where J is not closed). Let p be a signed measure on I. The 
k-th generalized moment of p is defined by 

(1) c k (p)=J^u k dp 

for all the indices k = 0, 1, . . . , n. 

Our main issue. We are concerned with the reconstruction of the target measure 
a from the observation of K.„ := (co(c), . . .,c n (o~)), i.e. its first (« + l) generalized 
moments. We assume that both the support S and the weights o~i of the target 
measure c are unknown. We investigate if it is possible to recover u uniquely 
from the observation of fC n . More precisely does an algorithm fitting K, n {a) among 
all the signed measures of I recover the measure a? 

Note that a finite number of assigned standard moments does not define a 
unique signed measure. In fact one can check that for each signed measure p 
and for each integer m > 1 there exists a measure /(' 7^ p having the same first 
m moments. It seems there is no hope of recovering discrete measures from 
a finite number of its generalized moments. Surprisingly we show that every 
extrema Jordan type measure a (see Definition 1 and the examples that follow) is 
the unique solution of a total variation minimizing algorithm, generalized minimal 
extrapolation. 

Basis pursuit. In [CDS98] Chen, Donoho and Saunders introduced basis pursuit. 
It is the process of reconstructing a target vector xq £ from the observation b = 
Axq by finding a sparse solution x* to an under-determined system of equations: 

(BP) x* 6 Arg min 1 1 y 1 1 j s.t. Ay — Axq , 

where A e R" xp is the design matrix. This program is one of the other first steps 
[CRT06a, Don06] of a remarkable theory so-called compressed sensing. As a result, 
this extremum is appropriated to the reconstruction of sparse vectors (i.e. vectors 
with a small support [Don06]). In this paper we develop a related program that 
recovers all the measures with enough structured Jordan support (which can be 
seen as the sparsity-related measures). 
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Generalized minimal extrapolation. Denote by M. the set of finite signed mea- 
sures on I and by || . \\ TV the total variation norm. We recall that for all u 6 Ai, 

\\ji\\ TV = sup IM £ )I ' 
n £ e n 

where the supremum is taken over all partitions n of I into a finite number of 
disjoint measurable subsets. By analogy with basis pursuit, generalized minimal 
extrapolation is the process of reconstructing a target measure a from the obser- 
vation K, n (o~) = (co(<j), ■ ■ .,c„ (a)) of its first n + 1 generalized moments c^c) by 
finding a solution of the problem 

(GME) a* G Arg min ||//|| Ty s.t. /C„ (u) = K,„ (cr) . 

On one hand, basis pursuit minimizes the ^-norm subject to linear constraints. 
On the other hand, generalized minimal extrapolation naturally substitutes the 
TV-norm (the total variation norm) for the i^-norm. For the case of Fourier 
coefficients, (GME) is simply Beurling Minimal Extrapolation [Beu38]. The program 
(GME) is named after this remark. 

Let us emphasize that generalized minimal extrapolation looks for a minimizer 
among all signed measures on I. Nevertheless, the target measure c is assumed 
to be of extrema Jordan type. 

Extrema Jordan type measures. Let us define more precisely what we understand 
by the Jordan support family Y. 

Definition 1 (Extrema Jordan type measure) — We say that a signed measure u 
is of extrema Jordan type {with respect to a family T = {uq, Ui,...,u n }) if and only if 
its Jordan decomposition u = u + — u~ satisfies 

Supp(f( + ) C and Supp(/i~) C Ep, 

where Supp(v) is defined as the support of the measure v, and 

• P denotes any linear combination of elements of T , 

• P is not constant and || < 1, 

• Ep [resp. Ep) is the set of all points x t such that P(x,-) = 1 (resp. P(x,-) = —1). 

In the following, we give some examples of extrema Jordan type measures with 
respect to the family 

These measures can be seen as "interesting" target measures for (GME) given 
observation of the first n + 1 standard moments. 

Examples with respect to the family T^. For the sake of readability, let n = 2m be an 
even integer. We present three important examples. 

Nonnegative measures: The nonnegative measures whose support has size 
s not greater than n/2 are extrema Jordan type measures. Indeed, let a be 
a nonnegative measure and S = {xi,...,x s } be its support. Set 

s 

P=l-cYl(x-Xi) 2 . 



4 



YOHANN DE CASTRO AND FABRICE GAMBOA 



Then, for a sufficiently small value of the parameter c, the polynomial P 
has supremum norm not greater than 1. The existence of such a polyno- 
mial shows that the measure c is an extrema Jordan type measure. 
In Section 2 we extend this notion to any homogeneous M-system. 
Chebyshev measures: The fc-th Chebyshev polynomial of the first order is de- 
fined by 

(2) T k (x) = cos(fcarccos(x)), Vx G [— 1,1]. 

It is well known that it has supremum norm not greater than 1, and that 

• E+ = {cos(2Z7rA), 1 = L!J}' 

• E" = { cos((2/ + l)n/k), 1 = LU }' 

whenever k > 0. Then, any measure c such that 

Supp(c + ) c Ej and Supp(c~) c Ej, 

for some < k < n, is an extrema Jordan type measure. 
Further examples are presented in Section 3. 
A-spaced out type measures: Let A be a positive real and Sa be the set of 
all pairs (S + , S~) of subsets of [—1, 1] such that 

Vx,i/ G S + U S~, x ^ y, \x — y\ > A. 

In Lemma 4.2, we prove that, for all (S + , S~) G Sa, there exists a polyno- 
mial P(s+,s-) suc h that 

• ^(S+ S~) has degree n not greater than a bound depending only on A, 

• P(s+,s-) is ec i ua l t° 1 on the set S + , 

• P(s+,s-) i s e( J ua l to —1 on the set S _ , 

• and || P(s+,s-) II °o < 1- 

This shows that any measure u with Jordan support included in Sa is an 
extrema Jordan type measure. 

In this paper, we give exact reconstruction results for these three kinds of extrema 
Jordan type measures. In fact, our results extend to others families T . Roughly, 
they can be stated as follows: 

Nonnegative measures: Assume that J 7 is a homogeneous M-system (see 
2.1.3). Theorem 2.1 shows that any nonnegative measure a is the unique so- 
lution of generalized minimal extrapolation given the observation K, n (cr), where 
n is not less than twice the size of the support of a. 

Generalized Chebyshev measures: Assume that T is an M-system (see def- 
inition 2.1.2). Proposition 3.3 shows the following result: Let a be a signed 
measure having Jordan support included in (E^,E^), for some 1 < k < n, 
where T/ c denotes the k-th generalized Chebyshev polynomial {see 3.3.1). Then a 
is the unique solution to generalized minimal extrapolation (GME) given K. n (c), 
i.e. its first (n + 1) generalized moments. 

A-interpolation: Considering the standard family T" = {l,x, x 2 , . . . ,x n }, 
Proposition 4.3 shows that generalized minimal extrapolation exactly recovers 
any A-spaced out type measure a from the observation K. n (cr), where n is greater 
than a bound depending only on A. 
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These results are closely related to standard results of basis pursuit [Don06]. In 
fact, further analogies with compressed sensing can be emphasized. 

Analogy with compressed sensing. Our estimator follows the aura of the recent 
breakthroughs [CDS98, CRT06a] in compressed sensing. 

In the past decade E. J. Candes, J. Romberg, and T. Tao have shown [CRT06b] 
that it is possible to exactly recover all sparse vectors from few linear measure- 
ments. They considered a matrix A £ R" X P with i.i.d entries (centered Gaussian, 
Bernoulli, random Fourier sampling) and an s-sparse vector xq (i.e. vector with 
support of size at most s). They pointed out that, with very high probability, the 
vector xq is the only point of contact between the £i-ball of radius ||*o|li an d the 
affine space {y, Ay = Axq}. This result holds as soon as n > C s log (p/s), where 
C > is a universal constant . In our framework we uncover the same geometric 
property: 

Let o~ be an extrema Jordan type measure. Then a is a point of contact between the ball of 
radius ||c||rv and the affine space {p € M., K.„(p) = K,„(o~)}, where n is greater than 
a bound depending only on the structure of the Jordan support of a. For instance, in the 
nonnegative measure case, if a has support of size at most s, then n = 2s suffices (see 
Theorem 2.1). 

Actually the reader can check that the above property is equivalent to the fact that 
the measure u is a solution of generalized minimal extrapolation (more details can 
be found in Section 1.2). Accordingly, generalized minimal extrapolation (GME) 
minimizes the total variation in order to pursue support of the target measure. 

Organization. This paper falls into four parts. The next section introduces gener- 
alized dual polynomials and shows that exact recovery can be understood in terms 
of an interpolation problem. Section 2 studies the exact reconstruction of non- 
negative measures, and gives explicit construction of design matrices for basis 
pursuit. Section 3 focuses on generalized Chebyshev polynomials and shows 
that it is possible to reconstruct signed measures from very few generalized mo- 
ments. The last section uncovers a property related to the nullspace property of 
compressed sensing. 

1. Generalized dual polynomials 

In this section we introduce generalized dual polynomial. In particular we are 
concerned with a sufficient condition that guarantees the exact reconstruction of 
the measure a. In fact, this condition relies on an interpolation problem. 

1.1. An interpolation problem. An insight into exact reconstruction is given by 
Lemma 1.1. Roughly, the existence of a generalized dual polynomial is a sufficient 
condition for the exact reconstruction of a signed measure with finite support. 

As usual, the following result holds for any family T = {uq,U\, . . .,u n } of 
continuous functions on I. Throughout, sgn(x) denotes the sign of the real x. 

Lemma 1.1 (The generalized dual polynomials) — Let nbe a positive integer. Let 
S = {x\, . . . ,x s } c I be a subset of size s and {e.\,. . .,£ s ) 6 {±1} S - If there exists a 
linear combination P = JJk=o a k u k sucn 



6 



YOHANN DE CASTRO AND FABRICE GAMBOA 



(z) the generalized Vandermonde system 

/u (*i) u (x 2 ) ••■ "o(*s)\ 
ui(xi) ui{x 2 ) ... ui(x s ) 

\u n (xi) u n (x 2 ) ... u n {x s )J 

hasfidl column rank, 
(n) P(Xj) = £,-, Vz = l,...,s, 
(Hi) \P(x)\ <1, Vxe [-1,1] \ 5, 

TTzen euery measure a = Ef=i cr /^x / / szzc/z f/zaf sgnfy,) = £,-, z's t/*ze unique solution of 
generalized minimal extrapolation given the observation JC n (cr). 

Proof. See A.l. □ 

The linear combination P considered in the Lemma 1.1 is called a generalized 
dual polynomial. This naming is inherited from the original article [CRT06a] of 
Candes, Tao and Romberg, and the dual certificate named by Candes and Plan 
[CP10]. 

1.2. Reconstruction of a cone. Given a subset S = {x\,. . .,x s } and a sign se- 
quence (s\,. . .,e s ) 6 {±1} S , Lemma 1.1 shows that if the generalized interpola- 
tion problem defined by (z), (z'z) and (Hi) has a solution then generalized mini- 
mal extrapolation recovers exactly all measures cr with support S and such that 

sgn(cr,-) = £/. 

Let us emphasize that the result is slightly stronger. Indeed the proof of A.l 
remains unchanged if some coefficients u, are zero. Consequently (GME) recovers 
exactly all the measures o~ of which support is included in S = {x\, . . .,x s } and 
such that sgn(u,) = £, for all nonzero c,. 

Let us denote this set by C(x%, t\, . . . , x s , e s ). It is exactly the cone defined by 

C(x 1 ,£ l ,...,x s ,e s ) = [ u i s xi ^ 0, sgn(fzO = e,]. 

i=i 

Thus the existence ofP implies the exact reconstruction of all measures in this cone. The 
cone C(x\, £\, . . . , x s , e s ) is the conic span of an (s — 1) -dimensional face of the 
TV-unit ball, that is 



T(%x, ei,... ,x s ,e s ) = I Zi^idxj Vz, A,- > Oand ^A,- = lj. 

i=l i=l 

Furthermore, the affine space {fz, K, n (u) = K, n (cr)} is tangent to the TV-unit ball 
at any point a E J~(x\, £\, . . . , x s , e s ), as shown in the following remark. 

Remark. From a convex optimization point of view, the dual certificates [CP10] and 
the generalized dual polynomials are deeply related: the existence of a general- 
ized dual polynomial P implies that, for all a G T(x\, £1, . . . , x s , e s ), a subgradient 
<J>P of the TV-norm at the point u is perpendicular to the set of the feasible points, 
that is 

{u, K n (u) = K n (o-)} C ker(<J> P ), 
where ker denotes the nullspace. A proof of this remark can be found in A.2. 
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1.3. On condition (i) in Lemma 1.1. Obviously, when = x k for k = 0, 1, . . . , n, 
conditions (it) and (Hi) imply that n > s and so condition (z). Nevertheless, this 
implication is not true for a general set of functions {uq, U\, . . . ,u n }. Moreover, 
Lemma 1.1 can fail if condition (z) is not satisfied. For example, set n = and 
consider a continuous function Uq satisfying the two conditions (z'z) and (Hi). 
In this case, if the target a belongs to J-(x\, £\, . . . , x s , e s ) (where X\, . . . , x s and 
£\, . . . , e s are given by (z'z) and (Hi)), then every measure \i 6 T(x\, £\, . . . , x s , e s ) 
is a solution of generalized minimal extrapolation given the observation /Co(c)- 
Indeed, 

\\} 1 \\tv = J 1 "odn = ^o(f)' 

for all i/ 6 T(x\, £\, . . . , x s , e s ). This example shows that condition (i) is neces- 
sary. Reading the proof A.l, conditions (it) and (Hi) ensure that the solutions to 
generalized minimal extrapolation belong to the cone C (x\, £\, . . . , x s , e s ), whereas 
condition (i) gives uniqueness. 

1.4. The extrema Jordan type measures. Lemma 1.1 shows that Definition 1 is 
well-founded. In fact, we have the the following corollary. 

Corollary — Let a be an extrema Jordan type measure. Then the measure a is a 
solution to generalized minimal extrapolation given the observation K, n (a). 

Furthermore, if the Vandermonde system given by (i) in Lemma 1.1 hasfidl column 
rank (where S = {xi,...,x s } denotes the support of a), then the measure a is the 
unique solution to generalized minimal extrapolation given the observation JC n (o~). 

This corollary shows that the "extrema Jordan type" notion is appropriate to exact 
reconstruction using generalized minimal extrapolation. 

2. Exact reconstruction of the nonnegative measures 

In this section we show that if the underlying family J- = {uq, u\, . . . , u n } 
is a homogeneous M-system then (GME) recovers exactly each finitely supported 
nonnegative measure u from the observation of a surprisingly few generalized 
moments. We begin with the definition of homogeneous M-systems. 

2.1. Markov systems. Markov systems were introduced in approximation theory 
[KN77, BE95, KS66]. They deal with the problem of finding the best approxima- 
tion, in terms of the £oo-norm, of a given continuous function in £oo norm. We 
begin with the definition of Chebyshev systems (the so-called T-system). They can 
be seen as a natural extension of algebraic monomials. Thus a finite combination 
of elements of a T-system is called a generalized polynomial. 

2.1.1. T-systems of order k. Denote by {u$, . . . , u^} a set of continuous real (or 
complex) functions on I. This set is a T-system of degree k if and only if every 
generalized polynomial 

k 

p = Y^mx, 

/=0 

where (do, . . . , fl; c ) 7^ (0, . . . , 0), has at most k zeros in I. 

This definition is equivalent to each of the two following conditions: 
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• For all xq, X\, . . . , x k distinct elements of / and all j/O/J/i/ ■ ■ ■ >}fk rea l ( or 
complex) numbers, there exists a unique generalized polynomial P (i.e. 
P 6 Span{i/o, «i, ... , u k }) such that P(xi) = yi, for all i — 0, 1, . . . ,k. 

• For all xq, . . . , x k distinct elements of I, generalized Vandermonde system 

/u (x ) MoOi) ... u (x k )\ 
Ui(x ) ui(xi) ... ui{x k ) 

\u k (x ) u k (xi) ... u k (x k )J 

has full rank. 

2.1.2. M-systems. We say that the family T = {uq, xi\, . . . , u n } is an M-system if 
and only if it is a T-system of degree k for all < k < n. Actually, M-systems are 
common objects (see [KN77]). We mention some examples below. 

In this paper, we are concerned with target measures on I = [—1,1]. Usually 
M-systems are defined on general Hausdorff spaces (see [BEZ94] for instance). 
For the sake of readability, we present examples with different values of I. In each 
case, our results easily extend to target measures with finite support included in 
the corresponding I. As usual, if not specified, the set J is assumed to be [—1, 1]. 

Real polynomials: The family T v = {1, x, x 1 , . . . } is an M-system. The real 

polynomials give the standard moments. 
Miintz polynomials: Let < a.\ < cli < ■ ■ ■ be any real numbers. The 

family T m = {1, x ai , x a2 r . . . } is an M-system on I = [0, +oo). 
Trigonometric functions: The family F cos = {1, cos (roe), cos (2 roe), . . . } is 

an M-system on I — [0,1]. 
Characteristic function: The family T c = {1, exp(mx), exp(z27rx), . . . } is an 

M-system on / = [—1,1). The moments are the characteristic function of c 

at points kn, k 6 N. It yields 

c /c( cr ) = J exp(iknt)do~(t) = cp a {kTi) . 

In this case, the underlying scalar field is C. 
Stieltjes transformation: The family F s — { jp^, ■ ■ ■}, where none of 
the z k 's belongs to [—1, 1], is an M-system. The corresponding moments 
are the Stieltjes transformation So-(z k ) of a, namely 

Laplace transform: The family T\ = {1, exp(— x),exp(— 2x),. . .} is an M- 
system. The moments are the Laplace transform Ca at integer points, 
namely 

c k {a) = J exp(-kt) dcr(f) = Ca{k) . 

A broad variety of common families can be considered in our framework. The 
above list is not meant to be exhaustive. 

Consider the family J- s = { z ^_ x , j^—^> . . . }. Note that no linear combination 
of its elements gives the constant function 1. Thus the constant function 1 is 
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not a generalized polynomial of this system. To treat such cases, we introduce 
homogeneous M-systems. 

2.1.3. Homogeneous M-systems. We say that a family T = {uq, U\, . . . , u n } is a ho- 
mogeneous M-system if and only if it is an M-system and Uq is a constant function. 
In this case, all constant functions c, with ceK (or C), are generalized polynomi- 
als. Hence the field R (or C) is naturally embedded in generalized polynomials. 
The adjective homogeneous is named after this comment. 

From any M-system we can always construct a homogeneous M-system. In- 
deed, let T = {uq, u\, . . .,u n } be an M-system. In particular the family J 7 is a 
T-system of order 0. Thus the continuous function Uq does not vanish in [—1,1]. 
In fact the family {1, . . ^} is a homogeneous M-system. 

All the previous examples of M-systems (see 2.1.2) are homogeneous, even 
Stieltjes transformation: 

£ = {l,^-,-J-,...}. 

I Zi — X Z2 — X ) 

Using homogeneous M-systems, we show that one can exactly recover all non- 
negative measures from a few generalized moments. 

2.2. An important theorem. The following result is one of the main theorems of 
our paper. It states that the generalized minimal extrapolation (GME) recovers all 
nonnegative measures u whose support is of size s from only 2s + 1 generalized 
moments. 

Theorem 2.1 — Let T be an homogeneous M-system on I. Consider a nonnegative 
measure a with finite support included in I. Then the measure a is the unique solution 
to generalized minimal extrapolation given observation K. n (cr), where n is not less than 
twice the size of the support of a. 

Proof. The complete proof can be found in B.l but some key points from the theory 
of approximation are presented in 2.2.1. For further insights about Markov systems, 
we recommend the books [KN77, KS66]. □ 

In addition, this result is sharp in the following sense. Every measure with sup- 
port size s depends on 2s parameters (s for its support and s for its weights). 
Surprisingly, this information can be recovered from only 2s + 1 of its generalized 
moments. Furthermore the program (GME) does not use the fact that the target 
is nonnegative. It recovers c among all signed measures with finite support. 

2.2.1. Nonnegative interpolation. An important property of M-systems is the ex- 
istence of a nonnegative generalized polynomial that vanishes exactly at a pre- 
scribed set of points {t\, . . . ,t m }, where f, G I for all i = 1, . . . , m. Indeed, define 

the index as 

m 

(3) Index(fi t m ) = £x(tj), 

;'=i 

where xif) = 2 if f belongs to / (the interior of 1) and 1 otherwise. The next 
lemma guarantees the existence of nonnegative generalized polynomials. 
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Lemma 2.2 (Nonnegative generalized polynomial) — Consider an M-system T 
and points t\,..., t m in I. These points are the only zeros of a nonnegative generalized 
polynomial of degree at most n if and only i/Index(fi, . . . , t m ) < n. 

A proof of this lemma is in [KN77]. Note that this lemma holds for all M-systems. 
However our main theorem needs a homogeneous M-system. 

2.2.2. Is homogeneous necessary? If one considers non-homogeneous M-systems 
then it is possible to give counterexamples that go against Theorem 2.1 for all 
n > 2s. Indeed, we have the next result. 

Proposition 2.3 — Let a be a nonnegative measure supported by s points. Let n be 
an integer such that n > 2s. Then there exists an M-system T and a measure y £ Ai 
such that /C„(<t) = lC„(u) and ||^|| T y < ||c|| Tv . 



Theorem 2.1 gives us the opportunity to build a large family of deterministic 
matrices for compressed sensing in the case of nonnegative signals. 

2.3. Deterministic matrices for compressed sensing. The heart of this article lies 
in the next theorem. It gives deterministic matrices for compressed sensing. We 
begin with some state-of-the-art results in compressed sensing. In the following, 
p denotes the number of predictors (or, from a signal processing view point, the 
length of the signal). 

Deterministic Design: As far as we know, for 



there exists [BGI + 08] a deterministic matrix A 6 ]R" X P such that basis 
pursuit (BP) recovers all s-sparse vectors from the observation Axq. 
Random Design: If 



where C > is a universal constant, then there exists (with high prob- 
ability) a random matrix A £ M. nx P such that basis pursuit recovers all 
s-sparse vectors from the observation Axq. 

The deterministic result holds for large values of s, n and p. For readability we do 
not specify the sense of large here. The reader may find an abundant literature in 
the respective references (see for example [BGI + 08, Don06]). 

Considering nonnegative sparse vectors, it is possible to drop the bound on n 

to 



Unlike the above examples, this result holds for all values of the parameters (as 
soon as n > 2s + 1). In addition it give explicit design matrices for basis pursuit. 
Last but not least, this bound on n does not depend on p. In special cases, this 
result has been previously developed in [DJHS92, Fuc96, DT05, DT10]. Using 
Theorem 2.1, it is possible to provide a generalization of this result to a broad 
range of measurement matrices: 



Proof. See B.2. 



□ 





n > 2s + 1 . 
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Theorem 2.4 (Deterministic Design Matrices) — Let n, p, s be integers such that 



Let {1, u\,..., u„} be a homogeneous M-system on I. Let t\,...,t v be distinct reals of 
I. Let A be generalized Vandermonde system defined by 



\u n {t\) u n (t 2 ) ■■■ u n (t p )J 

Then basis pursuit (BP) exactly recovers all nonnegative s-sparse vectors xq £ W from 
the observation Axq. 



Remark. The purely analytical components of this result are tractable back to the 
theory of neighborly polytopes (see for instance [DT05]) and in some sense trace 
to the theory of moment problems which essentially follows from Caratheodory 
work [Car07, Carll]. Other relevant work includes [KS53, Der56, Stu88]. This list 
is not meant to be exhaustive. 

Although the predictors could be highly correlated, basis pursuit exactly recovers 
the target vector xq. Of course, this result is theoretical. In practice, the sensing 
matrix A can be very ill-conditioned. In this case, basis pursuit behaves poorly. 

Numerical experiments. Our numerical experiments illustrate Theorem 2.4. They 
are of the following form: 

(a) Choose constants s (sparsity), n (number of known moments), and p (length 
of the vector). Choose the family J- (cosine, polynomial, Laplace, Stieltjes,...). 

(b) Select the subset S (of size s) uniformly at random. 

(c) Randomly generate an s-sparse vector xq of support S whose nonzero entries 
have the chi-square distribution with 1 degree of freedom. 

(rf) Compute the observation Axq. 

(e) Solve (BP), and compare with the target vector xq. 

The program (BP) can be recast as a linear program (see [CDS01] for instance). 
Then we use an interior point method to solve (BP). 

The entries of the target signal are distributed according to chi-square distribution 
with 1 degree of freedom. We chose this distribution to ensure that the entries 
are nonnegative. Let us emphasize that the actual values of xq can be arbitrary; 
only the sign matters. The result remains the same if we take the nonzero entries 
to be 1, say. 

Let us denote K : 1 1— > (1, U\(t), . . . , u n (t)). The columns of A are the values of this 
map at points t\, . . . , t„. For large p, the vectors K(tj) can be highly correlated. In 
fact, the matrix A can be ill-conditioned. To avoid such a case, we chose a family 
such that the map K has a large derivative. It appears that the cosine family gives 
very good numerical results (see Figure 1). 



s < min(n/2, p). 



A = 



/ 1 1 

u\{h) «i(f 2 ) 
u 2 (h) u 2 {t 2 ) 



1 \ 

Ml(fp) 
U 2 (t p ) 



Proof. SeeB.3. 



□ 
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Reconstruction ot a 20-sparse vector from 4) at 



O Target vector 
X Basis pursuit 



Figure 1. Consider the family = {1 / cos(7Tz),cos(27tx) / . . . } 
on I = [0,1] and the points t k = fc/501, for k = 1,. . .,500. The 
blue circles represent the target vector xq (a 20-sparse vector), 
while the black crosses represent the solution x* of (BP) from 
the observation of 41 cosine moments. In this example s = 20, 
n — 41, and p = 500. More numerical results can be found in 
Appendix D. This example shows that the reconstruction is ex- 
cellent. 



We investigate the reconstruction error between the numerical result x of the 
program (BP) and the target vector xq. Our experiment is of the following form: 

(a) Choose p (length of the vector) and N (number of numerical experiments). 

(b) Let s satisfy 1 < s < (p - l)/2. 

(c) Set n = 2s + 1 and solve the program (BP). Let X be the numerical result. 

(d) Compute the fi -error \\x — xo||i /p- 

(e) Repeat N times the steps (c) and (d), and compute Err s , the arithmetic mean 
of the t\ -errors. 

(/) Return HErr^l^, the maximal value of Err s . 

For p = 100 and N = 10, we find that 

HErrsL <0.05. 

Note that all experiments were done for n — 2s + 1. This is the smallest value of 
n such that Theorem 2.3 holds. 



3. Exact reconstruction for generalized Chebyshev measures 

In this section we give some examples of extremal polynomials P as they ap- 
pear in Definition 1. Considering M-systems, corollary of Lemma 1.1 shows that 
every measure with Jordan support included in (Ep, Ep ) is the only solution to 
(GME). Indeed, condition (z) of Lemma 1.1 is clearly satisfied when the underly- 
ing family J 7 is an M-system. 
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3.1. Trigonometric families. In the context of M-systems we can exhibit some 
very particular dual polynomials. The global extrema of these polynomials gives 
families of support for which results of Lemma 1.1 hold. 

The cosine family. First, consider the (n + 1) -dimensional cosine system 

•^cos := {l/COs(7rx), . . .,cos(n7rx)} 

on I = [0,1]. Obviously, extremal polynomials 

P k (x) = cos(knx), 

for k = l,...,n, satisfy WP^ < 1 and P k (l/k) = (-1)', for / = 0,1, . . . , (fc - 1). 
According to Definition 1, let us denote 

• E+:= {2l/k\l=0,...,[^\}, 

. Ep k :={(2/-l)/fc|/ = l,...,L|j}. 
The corollary that follows Lemma 1.1 asserts the following result. 

Consider a signed measure a having Jordan support (S + ,S~) such that S + C E„ and 

*■ k 

S~ C Ep^for some 1 < k < n. Then the measure a can be exactly reconstructed from 
the observation of 

(4) C cos{knt)da{t), k = 0,l,...,n. 

Jo 

Moreover, since the family J 7 "^ is an M-system, condition (/) in Lemma 1.1 is satisfied. 
Hence, the measure a is the only solution of (GME) given the observations (4). 

Using the classical mapping 

¥ . r [ai] -> [-Li] 

\ x i — y cos(7rx) ' 

the system of function (l,cos(/Tx), . . . ,cos(nnx)) can be push-forward to the sys- 
tem of functions (1, Tj(x ),..., T n (x)), where T k {x) is the so-called Chebyshev poly- 
nomial of the first kind of order k, k — 1, . . . , n (see 3.2). 

The characteristic function. By the same token, consider the complex valued Ad- 
system defined by 

J 7 " = {l,exp(inx), . . . ,exp(innx)} 
on 1 = [0, 2). In this case, one can check that 

P Kik {t) = cos(kn{t - oi)), Vf e [0,2), 

where a £ M. and < k < n/2, is a generalized polynomial. Following the 
previous example, we set 

• := {ct + 2l/k (mod 2) | I = 0,. . ., L^J }, 

• Ep := U+(2l-l)/k (mod 2) I I = 1,. . ., I f J }. 
Hence Lemma 1.1 can be applied. It yields the following: 

Any signed measure having Jordan support included in (Ep ,Ep ), for some a £ ]R 
and 1 < k < n/2, is the unique solution of (GME) given the observation 

J exp(iknt)dcr(t) = cp a (kTi), Vk = Q,...,n, 
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where cpcr(kn) has been defined in the previous section (see 2.1.2). 

Note that the study of basis pursuit with this kind of trigonometric moments has 

been considered in the pioneering work of Donoho and Stark [DS89]. 

3.2. Chebyshev polynomials. As mentioned in the introduction, the k-th Cheby- 
shev polynomial of the first order is defined by 

Tjt(x) = cos(fcarccos(x)), Vx 6 [—1,1] ■ 

We give some well known properties of Chebyshev polynomials. The k-th Cheby- 
shev polynomial satisfies the equioscillation property on [—1,1]. In fact, there exist 
k + 1 points £ = cos(7ri A) with 1 = £ > £j > ■ ■ ■ > £ fc = — 1 such that 

T k (Q = (-iy\\T k \u = (-iy, 

where the supremum norm is taken over [—1,1]. Moreover, the Chebyshev poly- 
nomial T/ c satisfies the following extremal property. 

Theorem 3.1 ([Riv90, BE95]) — We have 

min ||x' c -pO)|| = ||2 1 " ic r, c || = 2 1_fc , 

c II r\ J \\oo II Mloo ' 

where VS* denotes the set of complex polynomials of degree less than k — 1, and the 
supremum norm is taken over [—1,1]. Moreover, the minimum is uniquely attained by 
p(x) = x k -2 1 ~ k T k (x). 

These two properties, namely the equioscillation property and the extremal prop- 
erty, will be useful to us when we define generalized Chebyshev polynomial. 

Using Lemma 1.1 we uncover an exact reconstruction result. Consider the 
family 

on I = [-1,1]. Set 

• E+ = { cos(2/7r/fc), Z = 0,...,L§J}, 

• E Tk = {cos((2Z + 1)ttA), I = 0,..., LfJ}. 
The following result holds: 

Consider a signed measure a having Jordan support included in (Ej ,Ej), for some 
1 < k < n. Then the measure a is the only solution to (GME) given its first (n + 1) 
standard moments. 

Note that this result is restrictive in the location of the support points, they are 
not sparse in the usual sense, because they must be precisely located. Neverthe- 
less, it can be extended to any M-systems with the help of generalized Chebyshev 
polynomials. 

3.3. Generalized Chebyshev polynomials. Following [BE95], we define general- 
ized Chebyshev polynomials as follows. Let J- = {u$, U\, . . ■ , u n } be an M-system 
on I. 
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3.3.1. Definition. The generalized Chebyshev polynomial 

■£fc : = 2*{"0/ "1/ • ■ ■ / u n, 1} , 
where 1 < k < n, is defined by the following three properties: 

• Tfc is a generalized polynomial of degree k, i.e. % k 6 Span{«g, Mj, . . . , u k }, 

• there exists xq < x\ < ■ ■ ■ < x k such that 

(5) s S n(% k (x i+1 )) = -sgnCTjtfo)) = ± ||3*IL ' 

for i = 0, 1, . . — 1, 

• and 

(6) ||S' fc || 00 = l with T jt (maxZ)>0. 

The existence and the uniqueness of such 1 k is proved in [BE95]. Moreover, the 
following theorem shows that the extremal property implies the equioscillation 
property (5). 

Theorem 3.2 ([Riv90, BE95]) — The k-th generalized Chebyshev polynomial 
exists and can be written as 

k-i 

1 k = c(u k - J2 a i u i)> 

where uq, d\,..., fl/ c _i 6 1R are chosen to minimize 

k-i 
u k ~ a ' u ' 

i=0 

and the normalization constant ceK can be chosen so that 1 k satisfies property (6). 

Generalized Chebyshev polynomials give a new family of extrema Jordan type 
measures (see Definition 1). The corresponding target measures are named Cheby- 
shev measures. 

3.3.2. Exact reconstruction of Chebyshev measures. Considering the equioscillation 
property (5), set 

• as the set of the alternation point X\ such that sgn(1^(x ! ')) = H^H^,, 

• E% as the set of the alternation point X{ such that sgn(1^(x ! ')) = — (l^llco- 
A direct consequence of the last definition is the following proposition. 

Proposition 3.3 — Let a be a signed measure having Jordan support included in 
(Ej / E^ ),/or some 1 < k < n. Then a is the unique solution to generalized minimal 
extrapolation (GME) given K.„(o~), i.e. its (n + 1) first generalized moments. 

In the special case k = n, Proposition 3.3 shows that (GME) recovers all signed 
measures with Jordan support included in (Ej ,E^ ) from (n + 1) first gener- 
alized moments. Note that Ej U E^ has size n. Hence, this proposition shows 
that, among all signed measure on [—1, 1], (GME) can recover a signed measure of 
support size n from only (n + 1) generalized moments. In fact, any measure with 
Jordan support included in (E^ ,E^ ) can be uniquely defined by only (n + 1) 
generalized moments. 
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As far as we know, it is difficult to give the corresponding generalized Cheby- 
shev polynomials for a given family T = {uq, u\, . . . , u„}. Nevertheless, Borwein, 
Erdelyi, and Zhang [BEZ94] gives the explicit form of T/ c for rational spaces (i.e. 
the Stieltjes transformation in our framework). See also [DS89, HSS96] for some 
applications in optimal design. 

3.3.3. Construction of Chebyshev polynomials for Stieltjes transformation. We consider 
the case of Stieltjes transformation described in Section 2. In this case, Chebyshev 
polynomials 2^ can be precisely described. Consider homogeneous M-system on 
[—1/1] defined by 



where (z f )* =1 C C\ [-1,1]. 

Reproducing [BE95], we can construct generalized Chebyshev polynomials of 
the first kind. It yields 



where z is uniquely defined by x = 4(z + z _1 ) and |z| < 1, and fa is a known 
analytic function in a neighborhood of the closed unit disk. Moreover this analytic 
function can be expressed in terms of only (z,)^ =1 . We refer to [BE95] for further 
details. 



In this section we consider any countable family J- = {uq, u\, . . .,u n } of contin- 
uous functions on I. In particular we do not assume that J 7 is a non-homogeneous 
M-system. We aim at deriving a sufficient condition for exact reconstruction of 
signed measures. More precisely, we are concerned with giving a related prop- 
erty to the nullspace property [CDD09] of compressed sensing. 

Note that the solutions to program (GME) depend only on the first (n + 1) 
elements of J- and on the target measure a. We investigate the condition that 
the family J- must satisfy to ensure exact reconstruction. In the meantime, Co- 
hen, Dahmen and DeVore introduced [CDD09] a relevant condition, the nullspace 
property. Their property binds the geometry of the nullspace of A and the best 
k-term approximation of the target xq given the observation Axq. This well known 
property can be stated as follows. 

4.1. The nullspace property in compressed sensing. Let A s ]R" X P be a matrix. 
We say that A satisfies the nullspace property of order s if and only if for all 
nonzero vectors h in the nullspace of A, and all subsets of entries S of size s, 



where h$ denotes the vector whose z'-th entry is hj if i 6 S and otherwise. It is 
now standard that basis pursuit (BP) exactly recovers all s-sparse vectors Xo (i.e. 
vectors with at most s nonzero entries) if and only if the design matrix A satisfies 
the nullspace property of order s. 




^W = i(A(z)+/ /f (z)- 1 ), Vie [-1,1], 



4. The nullspace property for measures 



h s\\i < \\h s 4 



i ' 
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In this section, we show that the same property holds for generalized minimal 
extrapolation. According to the compressed sensing literature, we keep the same 
name for this related property. 

4.2. The nullspace property for generalized minimal extrapolation. Consider 
the linear map K.„ : p i— > (cq(}i), . . ., c n {}i)) from M. to We refer to this map 

as the generalized, moment morphism. Its nullspace ker(/C„) is a linear subspace of 
M.. The Lebesgue decomposition theorem is the precious tool used to define the 
nullspace property. 

4.2.1. The S-atomic part. Let p G M. and S = {x\, . . . ,x s } be a finite subset of I. 
Define A5 = Ef=i as me Dime comb with support S. The Lebesgue decompo- 
sition of pi with respect to As gives 

(7) p = p s + p S c, 

where p$ is a discrete measure whose support is included in S, and p$c is a 
measure whose support is included in S c :— I \ S. 

4.2.2. The nullspace property with respect to a Jordan support family . First, as in the 
standard compressed sensing context [CDD09], we define the nullspace property 
with respect to a Jordan support family Y. This property is only a sufficient 
condition for exact reconstruction of finite measure; see Proposition 4.1. 

Definition 1 (Nullspace property with respect to a Jordan support family Y) — 

We say that the generalized moment morphism K. n satisfies the nullspace property with 
respect to a Jordan support family Y if and only if it satisfies the following property. For 
all nonzero measures p in the nullspace ofK.„, and for all (S + ,S~) G Y, 

(8) II V~s II tv < ll^s c |lxy 
where S = S + U S~ . 

— The weak nullspace property states as follows: For all nonzero measures p in the 
nullspace of K n , and for all (S + ,S~) G Y, 

HFsIIxv ^ Ij"S c II TV ' 

where S = S + U S~ . 

Given a nonzero measure p in the nullspace of K. n , this property means that more 
than half of the total variation of p cannot be concentrated on a small subset. The 
nullspace property is a key to exact reconstruction as shown in the following 
proposition. 

Proposition 4.1 — Let Y be a Jordan support family. Let a be a signed measure 
having a Jordan support in Y. If the generalized moment morphism K n satisfies the 
nullspace property with respect to Y, then, the measure cr is the unique solution of 
generalized minimal extrapolation (GME) given the observation /C ;i (c). 

— If the generalized moment morphism K, n satisfies the weak nullspace property with 
respect to Y, then, the measure a is a solution of generalized minimal extrapolation 
(GME) given the observation /C tt ((j). 



Proof. See C.l. 



□ 
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As far as we know, it is difficult to check the nullspace property. In the following, 
we give an example such that the weak nullspace property is satisfied. 

4.3. The spaced out interpolation. We recall that Sa is the set of all pairs (S + , S~ ) 
of subsets of I = [—1,1] such that 

(9) Vx,yG S+US~, x £y, \x - y\ > A. 

The next lemma shows that if A is large enough then there exists a polynomial of 
degree n, with supremum norm not greater than 1, that interpolates 1 on the set 
S + and —1 on the set S~ . 

Lemma 4.2 — For all (S + , S~) 6 Sa, there exists a polynomial P( S + /S -\ such that 

• P(S+,S-) nas degree n not greater than (2/ yfn) {yfe/ A) 5 ^ 2+1 ^ A , 

• P(s+,s-) ' s equal to 1 on the set S + , 

• P(S+,S~) ' s equal to —1 on the set S~, 

• and \\P(s+,S-) 1 over I. 

Proof. SeeC.2. □ 

This upper bound is meant to show that one can interpolate any sign sequence 
on Sa- Let us emphasize that this result is far from being sharp. Considering L2- 
minimizing polynomials under fitting constraint, the authors of the present paper 
believe that one can greatly improve the upper bound of Lemma 4.2. Indeed, our 
numerical experiments are in complete agreement with this comment. Invoking 
Lemma 1.1, Lemma 4.2 gives the next proposition. 

Proposition 4.3 — Let A be a positive real. If n > (2/ y/n) (y/e/ A) 5/2+1/A then 
K-n satisfies the weak nullspace property with respect to Sa- 

Proof. SeeC.3. □ 

The bound (2/y/n) (y/e/ A) 5 ^ 2+1 ^ A can be considerably improved in actual prac- 
tice. The following numerical experiment shows that this bound can be greatly 
lowered. 

Some simulations. Our numerical experiment consists in looking for a generalized 
polynomial satisfying the assumption of Lemma 1.1. We work here with the co- 
sine system (l,cos(7rx),cos(27ix), . . .,cos(n7rx)) for various values of the integer 
n. As explained in Section 3, we can also consider the more classical power sys- 
tem (1, x, x 2 , . . . , x n ), so that our numerical experiments may be interpreted in 
this last frame. We consider signed measure having a support S with \S\ — 10. 
We consider A-spaced out type measures for various values of A. For each choice 
of A, we draw uniformly 100 realizations of signed measures. This means that the 
points of S are uniformly drawn on 7 10 , where I — [0, 1) here, with the restriction 
that the minimal distance between two points is at least A and that there exists 
two of points that are exactly A away from each other. Further, we uniformly 
randomized the signs of the measure on each point of S. As we wish to work 
with true signed measures, we do not allow the case where all the signs are the 
same (negative or positive measures). Once we simulated the set S + and S~ , we 
wish to build an interpolating polynomial P of degree n having value 1 on S + , 
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Figure 2. Consider the family J- cos = {l,cos(7rx) / cos(27rx), . . . } 
on I = [0,1]. Set s = 10 the size of the target support. We 
are concerned with signed measures with Jordan support in 
Sa (see (9)). The abscissa represents the values of 1/A (with 
A = 1/15,1/20,. . .,1/55), and the ordinates represent the val- 
ues of n (with n = 20, 30, ... , 100). For each value of (A, n), we 
draw uniformly 100 realizations of signed measures and the cor- 
responding L2-minimizing polynomial P. The gray scale repre- 
sents the percentage of times that WPW^ < 1 occurs. The white 
color means 100% ((GME) exactly recovers all the signed mea- 
sures) while the black color represent 0% (in all our experiments, 
the polynomial P is such that \\P\lgo > 1 over I). 

— 1 on S~ and having a supremum norm minimum. As this last minimization is 
not obvious, we relax it to the minimization of the I^-norm with the extra restric- 
tion that the derivative of the interpolation polynomial vanishes on S. Hence, 
when this last optimization problem has a solution having a supremum norm 
not greater than 1, Lemma 1.1 may be applied and (GME) leads to exact recon- 
struction. The proportion of experimental results, where the supremum norm of 
the Li optimal polynomial is not greater than 1, is reported in Figure 2. 

In our experiments we consider the values A = 1/15, 1/20, . . ., 1/55. Accord- 
ing to Proposition 4.3, the corresponding values of n range from 10 19 to 10 59 . In 
our experiments, we find that n = 80 suffices. 

Acknowledgements: The authors would like to thank Jean Paul Calvi and Viet 
Hung Pham for fruitful comments. We also thank anonymous referees for their 
careful reviews and their interesting suggestions. 

Appendix A. Proofs of Section 1. 

A.l. Proof of Lemma 1.1. Assume that a generalized dual polynomial P exists. 
Let a be such that a = Tf i=1 c,- S Xi , with sgn(c,) = e ( . Let a* be a solution of the 
generalized minimal extrapolation (GME) then J Pdcr = J Pda*. The equality 
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(it) yields = J Pdv. Combining the two previous equalities, 

Pda = [ Pda* = £ £i of + [ Pda^c , 



I TV 



i=l 



where e, = sgn(c;) and 



^ = E OiS*i + <rs" 
1=1 

according to the Lebesgue decomposition (7). Since \\P\lgg = 1, we have 



Pd(r$ c < \WsWtv + W^sAItv 



I TV ' 



Observe u* is a solution of (GME), it follows that |c"Hjy = ||c*|| T y and the above 
inequality is an equality. It yields J Pdo~g c = W^s^Itv Moreover we have the 
following result. 

Lemma A.l — Let v £ M. with its support included in S c . If J Pdv = \\v\\ TV 
then v = 0. 

Proof. Consider the compact set 

s 

n^AUh-i^i + ft v/oo, 
1=1 

Suppose that there exists k > such that ||vnJ| TV - 7^ 0. Then the inequality (Hi) 
leads to f n Pdv < \\vn k \\ TV - It yields 



I TV 



Pdv 



Pdv 



n;: 



Pdv < IIvq. 



* 1 1 TV 



veil 



TV 



I TV 



which is a contradiction. We deduce that H^nJIyy = 0/ ror all fc > 0. The equality 
v = follows with S c = Uj->o^\ • D 

This lemma shows that <J* is a discrete measure with its support included in S. 
In this case, the moment constraint K, n (o~* — a) = can be written as a generalized 
Vandermonde system, 





u (x 2 ) ■ 
"i (x 2 ) ■ 


■ u (x s )^ 

■ ui(x s ) 




o$ -o- 2 


\u n (xi) 


u„(x 2 ) ■ 


■ u n (x s )J 




\pt-Vs) 



From condition (/), we deduce that the generalized Vandermonde system is in- 
jective. □ 

A. 2. Proof of the remark in Section 1.2. Let a belong to J-(x\,£\, . . .,Xs,e s ). 
Consider the linear functional, 



$f.ji\-+ J fd]i, 

where / denotes a continuous bounded function. By definition, any subgradient 
®f of the TV-norm at point a satisfies, for all measures p E A4, 
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Thus, one can easily check that f is equal to 1 (resp. —1) on supp(u+) (resp. 
suppfV - )) and that WfW^ = 1. Conversely, any function / satisfying the latter 
condition leads to a subgradient Therefore, when it exists, the generalized 
dual polynomial P is such that Op is a subgradient of the TV-norm at point cr. Fur- 
thermore, let n be a feasible point (i.e. K. n (u) = K. n (o~)). Since P is a generalized 
polynomial of order n, we deduce that <3>p(u — cr) =0. Hence, the subgradient 
Op is perpendicular to the set of feasible points. □ 



Appendix B. Proofs of Section 2 

B.l. Proof of Theorem 2.1. The proof essentially relies on Lemma 1.1. Let s be an 
integer. Let cr be a nonnegative measure. Let S = {x^, . . . , x s } C I be its support. 
The next lemma shows the existence of a generalized dual polynomial. 

Lemma B.l (Dual polynomial) — Let s be an integer and n be such that n = 2s. Let 
J 7 be a homogeneous M-system on I. Let (x\, . . . , x s ) be such that Index(xi, . . . ,x s ) < 
n. Then there exists a generalized polynomial P of degree d such that 

(i) s < d < n, 

(it) P{x i ) = l, Vi = l,...,s, 
(Hi) \P(x)\ < lfor all x £ {x\, . . . , x s }. 

We recall that Index is defined by (3). Note that these polynomials are presented 
in the first example of Definition 1 . 

Proof of Lemma B.l. Let (x\,...,x s ) be such that Index(xi, . . . ,x s ) < n. From 
Lemma 2.2, there exists a nonnegative polynomial Q of degree d that vanishes 
exactly at the points x,. Moreover, its degree d satisfies (i). 

Since Q is continuous on the compact set J, it is bounded and there exists a real 
c such that | QW^ < 1/c. The generalized polynomial P = 1 — cQ is the expected 
generalized polynomial. □ 

Observe that 

• Using Lemma B.l, it yields that there exists a generalized dual polyno- 
mial, of degree at most n = 2s, which interpolates the value 1 at points 

{*!,. . .,X S }. 

• Since J- = {u$, U\, . . .,u n } is a T-system, the Vandermonde system given 
by (i) in Lemma 1.1 has full column rank. 

Invoke Lemma 1.1 to conclude. □ 

Remark. Since J 7 is a homogeneous M-system, the constant function 1 is a gener- 
alized polynomial. Note that the linear combination P = 1 — cQ is a generalized 
polynomial because 1 is a generalized polynomial. This assumption is essential 
(see 2.2.2). 

B.2. Proof of Proposition 2.3. Let cr = £; =1 <7/^ r; be a nonnegative measure. Let 
S = {x\, . . . , x s } be its support. Let n be an integer such that n > 2s. 
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Step 1: Let J 7 ;, = {1, u\, u 2 , ■ ■ ■ } be a homogeneous M-system (the standard poly- 
nomials for instance). Let t\, . . . , t n +\ 6 I\S be distinct points. It follows that the 

/ l ... l \ 

"i (fi) ». «i(ffi+i) 



Vandermonde system 

\ ll„{h) ... Un(*n+l) , 

(vi, . . . , v w+ i) e ]R' ,+1 such that 
i=l 

• and for all k — 0, . . . , n, j u^dv - 
Step 2: Set 



has full rank. Hence we may choose 



Mfcdcr. 



I TV 



W W TV ' 

Consider a positive continuous function uq such that 

• Wo(xi) = r, for z = 1, . . . ,s, 

• u (tj) — 1, for i — 1, . . .,n + 1, 

• the function Uo is not constant. 

Set J- = {uq, uq u\, uq U2, ■ ■ ■ }■ Obviously, J 7 is a non-homogeneous M-system. 
As usual, let K. n denote the generalized moment morphism of order n derived 
from the family T . 

Last step: Set \i = rv. An easy calculation gives /C„(c) = K. n (pi). Note that 



TV 



n+1 

E r \ V i 

i=l 



n+1 



M=l 



E?=i N + i 



I TV 



TV 



□ 



B.3. Proof of Theorem 2.4. Set T = {h, t p }. Let _M r denote the set of all 
finite measures of which support is included in T, Let ©7- be the linear map 
defined by 

J GR p ,4) -> (M T ,\\.\\ TV ) 
&T ' j (xi,...,x p ) 1 y 

One can check that ©7- is a bijective isometry. Moreover, it holds that 
(10) VyeRP, K, n {@ T {y)) = Ay, 

where A is the generalized Vandermonde system defined by 

/ 1 1 ... 1 \ 



P 
i=l 



«l(fe) 
M 2 (fl) "2(^2) 

\u n (ti) U n (t 2 ) 



u\{t v ) 
u 2 (t p ) 

Un(t p )J 



In the meantime, let xq be a nonnegative s-sparse vector. Let a = @-j-(xq). Observe 
that the support size of a is at most s. Consequently, Theorem 2.1 shows that a 
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is the unique solution to (GME). Since cr 6 Aij, we have that a is the unique 
solution to the following program: 

a = Argmin \\pi\\ TV s.t. K n {pi) = fC n (cr) . 

Using (10) and the isometry ©j-, it follows that xq is the unique solution to the 
program: 

Xq = Argmin \\y | j s.t. Ay = Axq . 

yew 

□ 



Appendix C. Proofs of Section 4 

C.l. Proof of Proposition 4.1. Let K.„ be a generalized moment morphism that 
satisfies the nullspace property with respect to a Jordan support family Y. Let cr 
be a signed measure of which Jordan support belongs to Y. Let cr* be a solution 
of (GME). Observe that ||cr*||7y< ||c|| rv -. Denote pi = cr* — cr and note that 
pi G ker(/C„). Then 

IK II TV = II <7 5IItV~HI £7 5 c IItV' 

= \W + M\tv + \\vs4tv> 

^ kllrv _ IIfsIItv + IIF5 c II rv 

where S denotes the support of cr. Suppose that pi ^ 0. The nullspace property 
yields that the measure pi satisfies inequality (8). We deduce ||c*||jy > IKHtV/ 
which is a contradiction. Thus pi = and cr* = a. □ 

C.2. Proof of Lemma 4.2. For sake of readability we sketch the proof here. Let 
(S + , S~) 6 Sa- Set S = S + U S~ = {x\, ...,x s }. Consider the Lagrange interpola- 
tion polynomials 

, , , Th&( x ~ 

for 1 < k < s. One can bound the supremum norm of Zj. over [0, 1] by 

\\h\L<L(*), 

where L(A) is an upper bound that depends only on A. Consider the m-th Cheby- 
shev polynomial of the first order T m (x) = cos(m arccos(x)), for all x £ [—1,1]. 
For a sufficiently large value of m, there exist 2s extrema of T m such that 
iCil — l/(sL(A)). Interpolating values Q at point x^, we build the expected 
polynomial P. We find that the polynomial P has degree not greater than 

C(V~e/A) 5/2+1/A , 



where C = 2/ ' sfn. 



□ 
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C.3. Proof of Proposition 4.3. Let y. be a nonzero measure in the nullspace of K.„ 
and (A,B) be in Sa- Let S be equal to A U B. Let S + (resp. S~) be the set of 
points x in S such that the ^-weight at point x is nonnegative (resp. negative). 
Observe that S = S + U S~ and (S + ,S~) £ Sa- From Lemma 4.2, there exists 
P( S + s -j of degree not greater than n such that P/ s + jS -) is equal to 1 on S + , —1 on 
S~, and || P(s+,s-) II oo < 1. It yields 

y p (s+,s-) d F= IIFsIItv + J sc p (s+,s-) d n > WhsWtv - IIfsHItv- 
Since ^ 6 ker(/C„), it follows that J Pt s + s -\dji =0. □ 
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Figure 3. These numerical experiments illustrate Theorem 2.4. 
We consider the family J- cos = {1,cos(;tx),cos(2;tx), . . . } and 
the points f/ c = k/ (p + 1), for k — l,...,p. The blue circles rep- 
resent the target vector Xq, while the black crosses represent the 
solution x* of (BP). The respective values are s — 10, n — 21, 
p = 500; s = 50, n = 101, p = 500; and s = 150, n = 301, p = 500. 

Note that some coefficients can be badly estimated (for instance when s = 50 
and n — 101). This might be due to the fact that we consider the limit case 
n = 2s + 1. Nevertheless, this is not the case when we have very few coefficients 
(s = 10 and n = 21) or a large number of moments (s = 150 and n = 301). As a 
general rule, we observe faithful reconstruction. 
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